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Abstract 

We show that the moving arithmetic average is closely connected to a Gauss-Seidel 
type fixed point method studied by Bauschke, Wang and Wylie, and which was ob- 
served to converge only numerically. Our analysis establishes a rigorous proof of con- 
vergence of their algorithm in a special case; moreover, limit is explicitly identified. 
Moving averages in Banach spaces and Kolmogorov means are also studied. Further- 
more, we consider moving proximal averages and epi-averages of convex functions. 
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1 Introduction 

Throughout this paper, we assume that m £ {2, 3, . . .} and that 
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and induced norm II • II. We also assume that 



m—l 

(2) dcq,..., oc m -i are nonnegative real numbers such that ol\ = 1, and a m := ocq. 

i=0 



It will be convenient to introduce the following notation for the partial sums and associ- 
ated weights: 



k 

(3) (Vfc € {0, 1, . . .,m — 1}) gfc = and a = {aQ,a\,. . .,fl OT _i)*. 

2=0 



and 

(4) 

(VfcG {0,l,...,»i-l}) A fc = ^ = ^ = ^/=°"' andA 

a e l^i=o <H E j= o E/=o a « 

We shall study the homogeneous linear difference equation 

(5) (Vn > m) y„ = a m _iy„_i H ha y„- m , where (y 0/ . . . ,y m -i) € K m . 

In the literature, this is called the moving average (and it is also known as the rolling aver- 
age, rolling mean or running average). It says that given a series of numbers and a fixed 
subset size, the first element of the moving average is obtained by taking the average of 
the initial fixed subset of the number series. Then the subset is modified by "shifting for- 
ward", excluding the first number of the series and including the next number following 
the original subset in the series. This creates a new subset of numbers, which is aver- 
aged. This process is repeated over the entire data series. The moving average is widely 
applied in statistics, signal processing, econometrics and mathematical finance; see, e.g., 
also B[10HT5HT3H2l. 

In BH |5l, we observed the numerical convergence of a Gauss-Seidel type fixed point 
iteration numerically, but we were unable to provide a rigorous proof. In this note, we 
present a connection between the moving average and this fixed point recursion; this 
allows us to give an analytical proof for the case when all monotone operators are zero. 



/ A \ 
\A m -i / 
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Moreover, the limit is identified. However this approach is unlike to generalize to the 
general fixed point iteration due to the interlaced nonlinear resolvents. 

While the results rest primarily on results from linear algebra, we consider in the second 
half of the paper several related highly nonlinear moving averages that exhibit a "hidden 
linearity" and thus allow to be rigorously studied. 

The paper is organized as follows. In Section |2j, we present various facts and auxil- 
iary results rooted ultimately in Linear Algebra. In Section [3] we establish the connec- 
tion between the moving average and the Gauss-Seidel type iteration scheme studied by 
Bauschke, Wang and Wylie, which leads to a rigorous proof for the convergence of their 
algorithm in the aforementioned special case. In Section H] we show that the iteration 
matrix has a closed form when otQ = and DL\ — ■ ■ ■ — oc m -\ = l/(m — 1). Moving Kol- 
mogorov means (also known as /-means) are considered in Section [5] In particular, var- 
ious known means such as arithmetic mean, harmonic mean, resolvent mean, etc. flOl 
all turn out to be special cases of this general framework. The final Section [6] concerns 
moving proximal averages and epi-averages of convex functions. 

Our notation follows ||3l[19l|23}|24]|. The identity operator Id is defined by X — >■ X : x i— >■ x. 
A mapping T: X — >■ X is nonexpansive (Lipschitz-1) if (Vx e X)(Vy e X) \\Tx — Ty\\ < 
1 1 x — y 1 1 . The set of fixed points of T is denoted by Fix T={xeX|x = Tx}. The following 
matrix plays a central role in this paper 







(0 


1 





... > 














1 







(6) 


A = 

























1 










«1 


Oil 


Oi m — i J 




Note that 












(7) 


Fix A = D = 


■{■ 


= ( 


X, x, . 


.,*) ex 


x e rJ, 



where D is also called the diagonal in X. By [19, page 648], the characteristic polynomial 
of A is 

(8) p(x) = X m — 0L m _\X m ~ X — • • • — 0L\X — DLq, 

and, in turn, A is the (transpose of the) companion matrix of p(x). 



As usual, we use C for the field of complex numbers; R+ (R++) for the nonnegative 
real numbers (positive real numbers); IN = {0,1,2,...} for the natural numbers. For 
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B G C mxm , jO(B) = max A6(7 / B ) |A| is the spectral radius of B and c(B) denotes the spec- 
trum of B, i.e., the set of eigenvalues of B. Given A £ c(B), we say that A is simple if its 
algebraic multiplicity is 1 and that it is semisimple if its algebraic and geometric multiplici- 
ties coincide. A simple eigenvalue is always semisimple, see ||T9l pages 510-511]. A vector 
y £ C m \ {0} satisfying By = Ay (y*B = Ay*) is called a right-hand (left-hand) eigenvector 
of B with respect to the eigenvalue A. (The * denotes the conjugate transpose of a vector 
or a matrix.) Then range of an operator B is denoted by ran(B); if B is linear, we denote 
its kernel by ker(B). It will be convenient to denote the zth standard unit column vector 
by e, and to also set e = Ya=\ e i = (1,1, . . . , 1)* £ X. We denote by S NxN the space of all 
N x N real symmetric matrices, while S^ xN and S^ xN stand, respectively, for the set of 
N x N positive semidefinite and positive definite matrices. The greatest common divisor of 
a set of integers S is denoted by gcd(S). Turning to functions, we let T(X) be the set of all 
functions that are convex, lower semicontinuous, and proper. We denote the quadratic 
energy function by q = i || • || 2 . Finally, the Fenchel conjugate g* of a function g is given by 
g*(x) = sup y6X ((x,y) - g{y)). 

2 Linear algebraic results 

To make our analysis self-contained, let us gather in this section some useful facts and 
auxiliary results on stochastic matrices, linear recurrence relations and the convergence 
of matrix powers. 

Basic properties of stochastic matrices 

Recall that a matrix B with nonnegative entries is called stochastic (or row-stochastic) if 
each row sum is equal to 1. (See [8] Chapter 8] or lH~9l Section 8.4] for more on stochastic 
matrices.) 

Fact 2.1 (See (19] pages 689 and 696].) Let B e R mxm be stochastic. Then p(B) = 1 and 1 is 
a semisimple eigenvalue ofB with eigenvector e. 

The proof of the next result is a simple verification and hence omitted. 

Proposition 2.2 The vectors a* and e are, respectively, left-hand and right-hand eigenvectors of 
A associated with the eigenvalue 1. 
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Linear recurrence relations and polynomials 

Consider the linear recurrence relation 

(9) (Vn >m) y n = a»»-iyn-:H VKoVn-m, where (y 0/ . . .,y w _i) £ K ra . 

Setting (Vn £ N) y W = (y n , y n +i, . . . , y n+m _i)*, we see that we can rewrite © as 

(10) (Vn £ N) y[ M+1 ] = AyW = ••• = A M+1 y [0] - 

This explains our interest in understanding the limiting behaviour of powers of A, which 
yield information about the limiting behaviour of (y^)neN and hence of (y n )neN- The 
solution to dU) depends on the roots of characteristic polynomial 

(11) p(x) = X m — 0L m -\X m ~ X — ■ ■ ■ — CL\X — OiQ 

of A. 

Fact 2.3 (See ||2Tl page 90] or 11201 pages 74-75]) Let k be the number of distinct roots U\, . . . , 
of dUJ with multiplicities m\, . . . ,m^, respectively. Then for each i e {1, . . . ,k}, there exists a 
polynomial c\\ of degree m, — 1 such that the general solution of © is 

k 

(12) (Vn £ N) y n = Y^qi(n)u?. 

i=l 

Consequently, ifk = m, i.e., all roots are distinct, then there exists (v\, . . . , v m ) £ C m such that 

m 

(13) (Vn£N) y n = $>,-u?. 

Fact 2.4 (Ostrowski) (See EU Theorem 12.2].) Lei {b x , b m ) £ R'" and set 

(14) t?(x) = x m - b x x m ~ x b m . 

Suppose that gcd {/c£ {1, . . . ,m} | ^ > 0} — 1- T/zen ^ has a unique positive root r. Moreover, 
r is a simple root of q, and the modulus of every other root of q is strictly less than r. 

See also |fi~2~ll22f for further results on polynomials. Let us now state a basic assumption 
that we will impose repeatedly. 

Basic Hypothesis 2.5 The polynomial p(x) given by (fi~T) has a unique positive root, 
which is simple and equal to 1, and each other root has modulus strictly less than 1. 
This happens if one of the following holds: 
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(i) gcd{z e {l,...,m} | cc m -i > 0} = 1. 

(ii) > 0. 

(iii) (3 i 6 {1, . . . , m - 1}) a m _ f a w _ (? - +1) > 0. 

(iv) (3 {z,/} C {1, . . . ,m - 1}) gcd{z',/} = 1 and a m _ 2 a m _ 7 - > 0. 



Proof, (i) This is clear from Fact 12.41 and the definition of p(x). (ii)-(iv) Each condition 



implies [(I) 



Limits of matrix powers and linear recurrence relations 



Fact 2.6 (See 03 pages 383-386, 518 and 630].) Let B e C mxm . Then the following hold: 



(i) (B n ) w€ iN converges to a nonzero matrix if and only ifl is a semisimple eigenvalue ofB and 
every other eigenvalue ofB has modulus strictly less than 1. 

(ii) If lim w€ ]N B" exists, then is the projector onto ker(Id — B) along ran(Id — B). 

(iii) If p(B) = 1 is a simple eigenvalue with right-hand and left-hand eigenvectors x and y* 

xy* 

respectively, then lim B" = . 

neN y*x 

Corollary 2.7 Suppose that the Basic Hypothesis \2.5\ holds. Then 



(15) 



lim A n = — = 

neN a*e Vf" 1 V fc n0 c- 



i=0 a i ••• E i= a i 1 



V*0 E?=o a i 



eA*. 



Proof. Clear from Proposition 12.21 Fact |2.6j(m) and the definitions. 



Corollary 2.8 Suppose that the Basic Hypothesis 12.51 fooZrfs and consider sequence (y«) n eN 
generated by the linear recurrence relation 

(16) (Vn > m) y„ = a m _iy w _i H h a y M -m, w/zere y = (y 0/ . . . ,y m -i) e ]R m - 

TTzen 



m—l 



(17) 



lim = ay = E^o flfcjft = EhE,o^ = y k 



6 



Proof. This follows from Corollary 12.71 and (fT0|). ■ 

Definition 2.9 Let Y be a real Banach space and consider the sequence (y n )nef^ zn Y generated 
by the linear recurrence relation 

(18) (Vn > m) y„ = a m _iy n _! H \-tx. Q y n - m , w/zere y = (y , . . .,y m -i) G Y m . 

JfliniMgisf y n exists, then we set it equal to £(y) and we write y G dom £ 

Remark 2.10 Note that dom t is a linear subspace of Y m , that {y = (y, . . . , y) G Y m | y G Y } C 
i', and that £ : dom i — > Y is a linear operator. Furthermore, 

(19) (V(y 0/ ...,y OT -i) G Y m ) {y„}«eN C conv{y 0/ . . .,y m _i} C span{y , . . . ,y m _i}. 
This implies 

(20) (Vy = (y 0/ ...,y m -i) G domf) £(y) G conv{y 0/ . . . ,y m _i} C span{y 0/ . . . ,y m _i} 
because the convex hull of finitely many points is compact (see, e.g., flTJ Corollary 5.30]). 

We are now ready to lift Corollary |2.8l to general Banach spaces. 

Corollary 2.11 Suppose that the Basic Hypothesis 12.51 holds and consider sequence (y w )neN 
generated by the linear recurrence relation 

(21) (Vn >m) y„ = a m _iy n _i H h a y„_ m , zyfere y = (y , . . . , y m _x) G Y m , 

where Y is a real Banach space. Then 

sr^m—l v-^m— 1 v-^ m— 1 

(22) Jg&y. = »-->) = fef = T m °-£l°f = E 

Proof. Denote the right-hand side of ((22J) by z, let y* G Y* and define (Vn G N) n n = 
y*(y M ). Applying y* to (|2l|) gives rise to the linear recurrence relation 

(23a) (Vn > m) n n = a m -\n n _ x H h K n n - m , 

where 

(23b) (n 0/ ...,n w _i) = (y*(y ), • • • ,y*(y m _i)) G R m . 

Corollary 12.81 and the linearity and continuity of y* imply that 

fc=0 ^fc * / Lfc=0_W \ 



(24) y*(y w ) = n n -+ ^-i = f ^-i = y*(z). 

It follows that (y M )«eN converges weakly to z. On the other hand, {y n )neTN lies not only 
in a compact subset but also in a finite-dimensional subspace of Y (see Remark |2.10|) . 
Altogether, we deduce that (y n )neN strongly converges to z. ■ 



Reducible matrices 



Recall (see, e.g., [TU, page 671]) that B e £ mxm [ s reducible if there exists a permutation 
matrix P such that 



(25) 



P*BP 



U W 
V 



where U and V are nontrivial square matrices; otherwise, B is irreducible. 
Proposition 2.12 Let B G c mxm fo^g fl f Zeasi one zero column. Then B is reducible. 

Proof. By assumption, there exists a permutation matrix P such that the first column of 
BP is equal to the zero vector. Then 

where IT = € C lxl and V G (£(w-l)x(w-l) are non trivial square matrices. ■ 



Circulant matrices 

It is interesting to compare the above results to circulant matrices. To this end, we set 







( a o 


«1 


0Lj_ ■ ■ 


• Km-l\ 






Oi m —i 


a 


DL\ ■ ■ 


■ K m -2 


(27) 


C = 


°<-m-2 


Oi m —i 


Ci Q • • 


■ Km-3 






V a l 


0.2 


a 3 • • 


CiQ J 



Fact 2.13 (See flS Theorems 1 and 2].) Set U = {k e {1, . . . , m} \ oc k > 0}. T/zen 
(28) L = lim C n exz'sis 

zjflnrf only ifj = gcd(LT U {m}) = gcd((fi — U) U {m}), in which case the entries o/L satisfy 



(29) 



7/m, z/z = ; (mod 7); 
0, otherwise. 



Remark 2.14 Note that C is bistochastic, i.e., both C and C* are stochastic. Since permu- 
tation matrices are clearly nonexpansive, it follows from Birkhoff 's theorem (see, e.g., 
[TTl Theorem 8.7.1]) that C is convex combination of nonexpansive matrices. Hence, C is 
nonexpansive as well. Moreover, one verifies readily that Fix C = D. 
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Example 2.15 Suppose there exists i £ {1, ...,m — 1} such that {z,z + l} C 17. Then 
(C n ) ne fq converges to the orthogonal projector onto D, i.e., 



(30) 



lim C n 



m 



ee 



1 

m 



(l 1 
1 1 



1\ 
1 



V 1 1 ••• V 

For further results on circulant matrices, see [14| and in particular fl6l . 



3 Main results 



In this section, we study the convergence of the Gauss-Seidel type fixed point iteration 
scheme proposed in dUSJ. Recalling ([2]), we set 



or entrywise 



(32) 



( T *)y 



A.', 



1, 

10, 



-k+j, if i = k and 1 < ; < k; 
if i = k and m > j >k; 
Hi ^ k and / = z; 
otherwise. 



Furthermore, we define 









«i 


«2 • 


0i m _ 






/ 1 


• • 


• \ 









l 


• 









CC m -i OCq 


Oil ■ ■ 


• %m-2 


(31a) 


Ti = 








1 • • 







, T 2 = 





1 • • 














• 


1 


) 




v 


• • 


• 1 / 






/l 





• 


• °) 

















1 


• 


• 










(31b) 










1 • 


• 
















A' 2 


0i 3 ■ 
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When ccq = 0, ot\ = ■ ■ ■ = a m _i = ^rj/ iterating T exactly corresponds to the algo- 
rithm investigated in |4j, [5] when all monotone operators are zeros. The authors there 
observed the numerical convergence but were not able to provide a rigorous proofs. We 
shall present a rigorous proof by connecting T and A. We start with some basic properties. 

Proposition 3.1 Let k G {1, . . . ,m}. Then the following hold: 

(i) Tfc and T are stochastic. 

(ii) If a® = 0, f/zen neither nor T z's nonexpansive. 

(iii) Jf «o — 0/ ^en neither nor T is irreducible. 



Proof. [(T)) By (0, is stochastic and so is therefore T as a product of stochastic matrices. 
(5)1 Indeed, in this case T^(e — e^) = e and thus ||Tjt(e — e^))) 2 = m > m — 1 = 



|e — ejt|| • Similarly T(e — ei) = e and thus ||T(e — e\] 



m > m 



e i| 



(iii) In this case, the and have a zero column, hence so does T. Now apply 



Proposition 12.121 

Proposition 13.11 illustrates neither the theory of nonexpansive mappings nor that of ir- 
reducible matrices (as is done in, e.g., © [HI) is applicable to study limiting properties 
of (T n ) nE fj. Fortunately, we are able to base our analysis on the right-shift and left-shift 
operators which are respectively given by 



(34) 



R 



(0 








...A 




(° 


i 


• 


• • 


\ 


1 








... o 










1 • 


• • 







1 





... o 


L = 








• 


• • 1 




v° 







i oj 









• 


• • 


/ 



Note that R and L are permutation matrices which satisfy the following properties which 
we will use repeatedly: 



(35) R T 



Id, R* 



R- 



L, V 



V 



R, R 



m—k 



L k , where k e {0, . . .,m). 



A key observation is the following result which connects and the companion matrix 

A. 

Proposition 3.2 For every k G {1, . . . , m}, we have 

(36a) Tjt = R k AL k ~ 1 , 
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(36b) 
(36c) 



k A/c-l 



R k A k , 



Ti 
T = A w 



Proof. We prove this by induction on k. Clearly, (|36a[) and (|36b|) hold when = 1. 
Now assume that (|36a|) and ((360) hold for some € {1, ...,m — 1}. Then T^+i = 
#T fc L = R(R k AL k ~ 1 )L = R k+1 AL k , which is CH for jfc + 1. Hence T fc+1 ■ ■ - Ti = 
T fc+1 (T fc • • • Ti) = (R k+1 AL k )(R k A k ) = R k+1 A k+1 , which is ((360) for k + 1. Finally d36cl 
follows from (|33]> and (|36b|) with k — m. ■ 

We are now able to derive our main results which resolves a special case of an open 
problem posed in (5]|. 

Theorem 3.3 (main result) Suppose that the Basic Hypothesis 12.51 holds. Then 



(37) lim T M 

neN 



and Fix T = D 



ea^ 



(*o El 

a E?=0 a i 



a e E fc =o Ei=o a i 

FixTi n • • • Pi FixT m . 



a.j 



Er=o 2 «i i \ 
Er=o 2 ^ i 



i=0 a * 1 / 



eA*. 



Proof. In view of (|36c|) , it is clear that (T M ) n€ iN is a subsequence of (A n ) ne fj. Hence ((37) 
follows from Corollary 12 .71 

Now set L = lim w€N T M = a*e/(e*a). On the one hand, D = Fix A C FixT by © 
and (|36c|) . On the other hand, FixT C ranL C D. Altogether, FixT = D. Finally, clearly 
FixTi n •• • FixT m C Fix T = D C Fix Ti D ■ ■ ■ D FixT m . ■ 

Remark 3.4 Theorem 13.31 with the choice (ccq, . . . , oc m -\) = (m — 1) _1 (0, 1, 1, 1), set- 
tles [5, Questions Ql and Q2 on p. 36] when all resolvents coincide with Id. Furthermore, 
((37) gives an explicit formula for the limit of (T n ) n efi- 



4 A special case: &o = and ot\ = • • • = cc m -\ = l/(m — 1) 

This assignment of parameters was the setting of 10. In this case, even closed forms for 
T, and for the partial products T^T^ • • • Ti and A k , are available as we demonstrate in 
this section. To this end, we abbreviate 



(38) 



1 



m 
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Then (|3~Tj) and turn into 



Proposition 4.1 Define T £ ]R"' xm entrywise by 

7(1 + 7)^ 



(40) 



T 



Lef A: e {1, . . . , m}. Then 
(41) 

or entrywise 



TYT 



'/7rsi rows o/T 

0(m— fc)xfc Im—ky 







/o 


7 
i 


/ 


• 7^ 




A 





• 


• 0\ 









i 


• • 


• 




7 





7 • 


• 7 


/on \ 

(39a) 


Ti = 


n 


n 


1 


n 


T 2 = 


n 


n 


i 


n 






l° 





• • 


• V 




v° 





• 


• V 




• • • / 


(1 





• 


• °^ 




^0 


1 


• • 


• °\ 









1 


• 


• 










1 • • 


• 


(39b) 


T/77 = 








1 • 


• 


, and A = 








• • 


• 








7 


7 • 






V° 


7 


7 •• 


• V 



Tu, ifl<i< k; 

(42) (Tj/Tk-i ■ ■ • Ti) . • := ^ 1, ifk+l<i<m and j = i; 

0, zY k + 1 < i < m and j ^ i. 



In particular, 
(43) 



T = T. 



Proof. Set 

(44) s^iyr^i.-.T!. 

We prove (|41~T) by induction on k G {1, . . . , m}; the rest follows readily. 
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k = 1: On the one hand, by definition, 



(45) 



fO 7 7 • • • 7^ 

1 ••• 

1 ••• 

[0 ••• lj 



On the other hand, the first row of T is, using (|40l> , is (0, 7, . . . , 7). Hence the statement is 
true for k — 1. 

k — 1 ^ k: Assume the statement is true for k G {2, . . . , m}, i.e., 

first k — 1 rows of T \ / first k — 1 rows of T 



(46) T ]t _ 1 ---T 1 = 
or entrywise, this matrix S satisfies 



0(m-(/c-l))x(fc-l) Im-(k-l)J \0(m-fc+l))x(fc-l) ^m-k+Y^ 



{%,), if 1 < * < fc — 1; 
1, if k<i<m and ; = z; 
0, xfk < i < m and / 7^ z. 

Recall that 

{7, if z = fc and / 7^ fc; 
1, ifi^fcand/ = i; 
0, otherwise. 

It is clear that T^S = T^Tj-_i ■ • • Ti. We must show that 

first k rows of T 



(49) T fc S = 



0(m— k)xk Im—k, 



We do this entrywise, and thus fix z and / in {1, . . . , m}. 

Case 1: 1 < i < k — 1. 

Then (T/ c S) !; y = 2^/=i( r Tfc)i,/S/ / y = (Tk^Sj ; = S 2/ y, which shows that the first k — 1 rows 
of TfcS are the same as the first k — 1 rows of S, which in turn are the same as the first k — 1 
rows of T, as required. 

Case 2: i = k. 

Then (T /c S)^ = (T fc S) /cj - = E/li( T fc)/c,/ s ;,/ = E/=i( T /c)u S /,/ + T,T=k+i( T k)k,i^i,j = 

Efci 1 7%,j + J2T=k+i 7 s ij- 
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Subcase 2.1: j < k - 1. Then (T fc S) i/7 - = (T k S)k,j = Ef=i7 T /,; = 7Ej = i T 'j + 

7 £fc/ t Z/7 - = 7 EC! 7(i + 7)'" 1 + 7 Et/ M 1 + - 2 (1 + 1)'" 7 ) = ^ 2 SfciC 1 + 

7)'" 1 " 7 Et/ ^ + = ^ + - ^ + = = T y- 

Snta2.2: ; = fc. Then (TjfcS)y = (T,S) U = £*z} 7 T ZjJfc = 7 Efc? 7(1 + 7)' _1 = 
7(l + 7) fc " 1 -7 = T, a = T !J . 



Suto2.3: fc + 1 < ;. Then (T fc S) i/7 - = (T k S) k/j = EU^H + l = 7EtiS(l + 
7 y-i + 7 = ?(1 + 7) fc-i = Xjy = f. 

Case 3: i >k + l. 
Then (T fc S);, ; - = EHiWySy = (T fc ) M S ZJ = S t/ . 

Subcase 3.1: j = i. Then (T^S)^ = S J/Z - = 1. 

Subcase 3.2: j ^ i. Then (TfcS)j = = 0. 

Altogether, we have shown that 

first rows of T' 



(50) T fc S 



0(m— fc)xfc Im—k, 



The "In particular" part is the case when k = m. 
Corollary 4.2 Let k G {1, . . . , m}. Then 



k ( ®(m—k)xk Im—k 

.first k rows o/T 



(51) A 

or entry wise 

{1, ifl<i<m — k and j = i + k; 

0, if I <i <m-kandj ^i + k; 

Tj + fc_ m 4, ifm — k + 1 < i < m. 

Proof. Proposition 13.21 yields A k = L^(T^T^_i ■ • • Ti) and the result now follows from 
Proposition 14. II ■ 

Remark 4.3 We do not know whether it is possible to obtain a closed form for the powers 
of T that does not rely on the eigenvalue analysis from Section |2] If such a formula exists, 
one may be able to construct a different proof of Theorem 13.31 in this setting. 
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5 Kolmogorov means 



We now turn to moving Kolmogorov means, which are sometimes also called /-means. 

Theorem 5.1 (moving Kolmogorov means) Let D be a nonempty topological Hausdorff 
space, let Zbe a real Banach space, and let f ': D — >• Z be an injective mapping such that ran / is 
convex. Consider the linear recurrence relation 

(53a) (Vn >m) y„ = f~ l {oi m -if(y n -\) H h uof(y n -m)), 

where 

(53b) (yo,..-,y m -i) £D ffl 

Then the following hold: 

(i) The sequence (y M )«eN * s weZZ defined and the sequence (f(y n ))nefi H es zn the compact 
convex set conv{/(yo), • • • //(ym-i)}- 

(ii) Suppose that the Basic Hypothesis 12.51 holds and that f~ l is continuous from /(D) to D. 
Then 

(54) 



fc=0 



Proof, (i) This is similar to Remark |2.10| and proved inductively. 



(ii) By Corollary E3H (/(]/« ))neN converges to £{f(yo), ■ ■ ■ ,f{y m -\)), which belongs 



to conv{/(yo), . . . ,/(y m -i)} C conv/(D) = /(D) = ran / by assumption and[(i)j Since 
/ _1 is continuous, the result follows from (f22~)) . ■ 



Theorem |5JpT) allows for a universe of examples by appropriately choosing / and 



(do, . . . , a m -\). Let us present some classical moving means on (subsets) of the real line 
with the equal weights olq = ■ ■ ■ = (X- m -i — 1/wt. Note that the Basic Hypothesis 12.51 is 
satisfied. 

Corollary 5.2 (some classical means) Let D be a nonempty subset o/R, let (yo, . . . ,y m -\) £ 
D m . Here zs a Zz'sf of choices for f in Theorem\5H along with the limits obtained by (|54"1) : 

(i) Jf D = R and / = Id, ZZzen fZze moving arithmetic mean sequence satisfies 

112 m_1 

(55) y M = — y„_i H h — y«- m -> -7 — — rr V (7 + l)yy. 

m m m(m + l) ^ 1 

v ; 7=0 
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(ii) IfD = 1R++ and f = In, then the moving geometric mean sequence satisfies 

m—l 



(m—x \ 
II 



m(m+l) 



7=0 

(iii) IfD — K.+ and f:x^xP, then the moving Holder mean sequence satisfies 

/ , 1 / 2 m ~ X 

y » + »=(-^- 1 + --- + -yS) -(^TryEO + Dyf) • 

(iv) IfD = 1R++ and f: x i— >■ 1/x, i/zen f/xe moving harmonic mean sequence satisfies 

(58) y B+m =(!_!_ + ••• + --) ^ f -p ^ ^ EO' + l)-) 

Let us provide some means situated in a space of matrices. 
Corollary 5.3 (some matrix means) Let (Yq, . . . , Y m _i) G S^ N . Then the following hold: 

(i) 77ze moving arithmetic mean satisfies 

1 1 2 m-l 

(59) Y n = -Y„_i + • • • + -Y M _ m -> V (; + l)Y y . 

(ii) T/ze moving harmonic mean satisfies 

-1 / n m—l 



(60) y w = (I y-Jj + • • • + Iy-O ->> f , * V (i + 1) Yf 1 ) 

\m " 1 m 7 \m(m + l) r^; 7 / 

(iii) The moving resolvent mean (see also ) satisfies 

Yn= f-(Y M _ 1 + Id)- 1 + --- + i(Y n _ m +Id)- 1 ) -Id 
\m m ) 

— j— — —r y (; + 1 ) ( Y + Id) - 1 - Id . 



Proof. This follows from Theorem |5J] with D = S^* N and / = Id, / = X H> X" 1 , and 
/ = X i— >• (X + Id)" 1 , respectively. Note that matrix inversion is continuous; see, e.g., Ifl9l 
Example 6.2.7]. ■ 
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6 Moving proximal and epi averages for functions 



In this last section, we apply the moving average (in particular Corollary I2.8|) to functions 
in the context of proximal and epi averages. Let us start by reviewing a key notion (see 
also EHHIH). 

Definition 6.1 (epi-convergence) (See ||24l Proposition 7.2].) Let g and (g n )neiN be func- 
tions from X to ] -co, +oo]. Then 

(i) (gn)neN epi-converges to g, in symbols g n A g, if for every xeX one has 

(a) (V (x m )„ 6 n) x„ ->• x => g(x) < lim gnUn), and 

(b) (3 (y B )neN) 3/n ->■ * iim gn(yn) < g(x); 

(ii) (g M )n€N pointwise converges to g, in symbols g n A g, if for every x £ X we have 
g(x) = lim„ 6N g M (x). 

Let g : X — >■ ] — oo, +oo] be an extended real valued function. Recall that 

(62) (gD q) : x ^ mf (g(y) + - y|| 2 ) 

is the Moreau envelope of g. By [24, Theorem 2.26], if g G T(X), then q is convex 
and continuously differentiable on X. Especially important are the following connections 
among epi-convergence pointwise convergence of envelopes, and the epi-continuity of 
Fenchel conjugation. 

Fact 6.2 (See ES Theorems 7.37 and 11.34].) Let (g n )neK and g be in T(X). Then 

(63) gn^g & g„DqAgDq & g» A g*. 

We now turn to the moving proximal average (see (U for further information on this 
operation). 

Theorem 6.3 (moving proximal average) Let (go, . . . ,g m -\) £ (r(X)) m and define 

(64) (Vn > m) g M = (a m _i(g M _! + q)* H h ao(g n -m + q)*)* - q. 

T/zen the following hold: 



(i) T/ie sequence (g n )neK H es zn T(X). 
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(ii) (Vn > m) g n U q = a m _i(g„_iD q) H h a (g n - m D q). 

(iii) Suppose that the Basic Hypothesis 12.51 holds. Then 

(65a) g«Ag = (A m _i(g m _i + q)* + • • • + A (g + q)*)* - q- 

and 

(65b) g;Ag*= (A m _i(g* _! + q)* + • • • + AofoS + q)T - q- 



Proo/. [(!)) Combine |6, Propositions 4.3 and 5.2]. 



(ii) See © Theorem 6.2]. 



(m)| It follows from pj] and Corollary |Z8] that £„□ q -4 A fc(^fc D q) = £ D q- Th e 



result now follows from Fact 16.21 and HI Theorem 5.1]. 

We conclude the paper with the moving epi-average. Recall that for oc > and g £ 
T(X), a -frg = o a -1 Id and that -kg = £{ }- 

Theorem 6.4 (moving epi-average) Let (go, . . . ,g m -\) £ (r(X)) m and define 
(66) (Vn > m) g„ = (oc m -\ *g n _i)D • • • □(a *gn-m)- 

Suppose that for every k £ {0, . . . ,m — 1}, g^ is cofinite and that the Basic Hypothesis 12.51 
holds. Then 



(67) g n ->■ g = (A m _i ★g n _ 1 )D • • • D(Ao -kgn-m)- 

Proof. It follows from ||3l Proposition 15.7(iv)] that (Vn £ N) g„ £ T(X), g n is cofinite, and 
gn is continuous everywhere. Furthermore, taking the Fenchel conjugate of (|66)) yields 

(68) (Vn > m) g* = cc m -\g* n -\ + ■■■ + oc gn-m- 

This and Corollary 12.81 imply not only that g* g* but also that the sequence (g„) n eN 



is equi-lsc everywhere (see [241 pages 248f]). In turn, |24l Theorem 7.10] implies that 
Sn %*• Th e conclusion therefore follows from Fact l6.21 ■ 
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